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SAMPLING TIME-FREQUENCY LOCALIZED FUNCTIONS AND 
CONSTRUCTING LOCALIZED TIME-FREQUENCY FRAMES 

MONIKA DORFLER AND GINO ANGELO VELASCO 


Abstract. We study functions whose time-frequency content are concentrated in a 
compact region in phase space using time-frequency localization operators as a main 
tool. We obtain approximation inequalities for such functions using a finite linear com¬ 
bination of eigenfunctions of these operators, as well as a local Gabor system covering 
the region of interest. These would allow the construction of modified time-frequency 
dictionaries concentrated in the region. 


1. Introduction 

When processing audio signals such as music or speech, one sometimes strives for 
a meticulous separation of signal components in time and frequency. However, it is 
known that no nonzero function can be compactly supported simultaneously in time and 
frequency, so that good concentration in one domain usually has to be paid for with 
increased leakage in the other domain. Due to this trade-off, window design has been an 
important issue in signal processing. As opposed to traditional approaches, we investigate 
the optimization of concentration simultaneously in time and frequency. More precisely, 
we investigate functions that exhibit good concentration in a compact region in the time- 
frequency plane. Our method is related to the approach introduced by Landau, Slepian, 
and Poliak, who considered operators composed of consecutive time- and bandlimiting 
steps, cf. [25l [151 [T9] . The resulting operators yield the well-known prolate spheroidal 
functions as eigenfunctions. These functions satisfy some optimality in concentration in 
a rectangular region in the time-frequency domain. 

In g], Daubechies introduced time-frequency localization operators obtained by re¬ 
stricting the synthesis from time-frequency coefficients to a desired region of interest. 
Here, we make use of time-frequency localization operators to describe a function’s lo¬ 
cal time-frequency content in regions more general than the rectangles considered in 
gauging. As in the case of the prolate spheroidal wave functions, the eigenfunctions 
of the time-frequency localization operators are maximally time-frequency-concentrated 
in the region of interest. We will use these eigenfunctions to characterize a function’s 
time-frequency localization. 

Using Gabor frames, we show, to which extent time-frequency localized functions can 
be approximated using only a finite number of Gabor coefficients, namely, those which 
are inside some larger cover of the given region. This is influenced by the approximation 
result formulated by Daubechies in a seminal paper [5]. Similar estimates were also 
established in ES- 

Using the obtained results, we construct global time-frequency frames consisting of 
atoms which are optimally concentrated in small regions corresponding to a prescribed 
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lattice. Each locally concentrated system is constructed by projecting the local Ga¬ 
bor atoms onto the subspace spanned by a finite number of eigenfunctions. Then, by 
considering a family of such locally concentrated time-frequency dictionaries, we obtain 
an adaptive frame for all T 2 (R). The resulting frames are useful for processing tasks 
in which, as explained above, certain signal components have to be processed separately 
with minimum distortion of close-by signals parts. We will give an application example in 
the experiments Section [5j Note that a similar construction involving prolate spheroidal 
functions has recently been studied in [Kl¬ 
in the next section, we recall the necessary tools from time-frequency analysis, namely, 
the short-time Fourier transform and Gabor frames. In Section [3j we review some prop¬ 
erties of time-frequency localization operators, and we prove characterization and ap¬ 
proximation results concerning time-frequency localized functions and eigenfunctions of 
time-frequency localization operators. Section [4] deals with approximation using a local 
Gabor system and the construction of the new time-frequency dictionaries. Finally, in 
Section [5j we present numerical experiments concerning our results and conclude with 
some perspectives in Section [6) 


2. Preliminaries 

In this section we recall some definitions and properties about the short-time Fourier 
transform and Gabor frames. For a thorough introduction to the field of time-frequency 
analysis, we refer the reader to [l4j . 

Fix a window function ip E L 2 (R) with norm \\<p \\2 = 1- The short-time Fourier 
transform (STFT) of / E T 2 (R) with respect ip is given by 

(1) V v f(z) = V v f(x,u)= [ f(t)ip{t- x)e~ 2mu ' t dt = (f,ir(z)tp), 

Jr 

where z = (x,oj) E R 2 and tt(z) is the time-frequency shift operator given by 7 r(z)f = 
f{t—x)e 2mu} ' t . The STFT is an isometry from L 2 (R) to L 2 (R 2 ), i.e. = IMI2II/H2, 

and inversion is realized using the formula 

(2) f = V*V ip f=[[ Vvf^TT^ipdz. 

J J R2 

The membership of the STFT in L p ( 1R 2 ) provides a definition of a class of function 
spaces called modulation spaces. In particular, for a fixed non-zero window function ip E 
<S(R), the modulation space AP(R) is defined as the space of all tempered distributions 
/ E <S'(R) such that V. p f E L P (R 2 ). It is a Banach space equipped with the norm 
II/IImp(R) := ll'l / V/lli>(R 2 ), where a different window function (p would yield an equivalent 
norm. Note that for tp E T 2 (R) with ||^||2 = 1, the isometry of the STFT implies that 
Af 2 (R) = L 2 ( R). The space S’q(R) = Af x (R) is also known as Feichtinger’s algebra. It 
is the smallest Banach space isometrically invariant under time-frequency shifts and the 
Fourier transform, cf. m- 

Discretization of the time-frequency representation via the STFT leads to the theory of 
Gabor frames. We consider a Gabor system G(g, A) with window function g E L 2 (R) and 
a countable set of points A in R 2 , consisting of time-frequency shifted copies of a function 
g, i.e. Q(g,k) := := 7r(A)g}AeA- We say that Q(g, A) is a frame for / E L 2 (R) if 

there exist constants A, B > 0 such that for all / E T 2 (R) 

(3) All/111 < 53 £ Sll/lll- 

AeA 
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If A = B, then we say that G(g, A) is a tight frame. 

Associated with the frame G(g, A) is the frame operator S given by 

Sf = ^2(f,g\)g\- 

AeA 

The frame conditions m are equivalent to the invertibility of S, and reconstruction 
from the coefficients {(/,5a)}A eA is possible because of the existence of a dual frame 
{ZaIagA, the canonical one being {5 ,_1 5a}agA, having frame bounds B~ l and A -1 . Every 
/ € L 2 (R) will then have the expansion 

( 4 ) f = ^2(f,g\)g~\ = ^2(f,g~\)g\, 

AeA AeA 

where both series converge unconditionally in L 2 (R). If G(g, A) is a tight frame, then 
Sf = Af so / = \Sf. 

Moreover, if Q{g, A) is a frame, then the analysis operator U given by Uf = {(/, 5a)} AeA 
and its adjoint U*, called the synthesis operator , given by U*c = X)agA c a5a, c = {ca}agA, 
are bounded from T 2 (R) into £ 2 (A) and £ 2 {A) into T 2 (R), respectively, with operator 
norms ||£/j|op = ||C/*||op < y /~ B - For the dual frame (5a}agA, the associated analysis 
and synthesis operators are also bounded operators with operator norms not exceeding 

i/Va. 


3. Time-frequency concentration via the STFT 

Time-frequency localization operators as introduced by Daubechies in [1] are built 
by restricting the integral in the inversion formula © to a subset of R 2 . Its properties, 
connections with other mathematical topics, and applications have been topics in various 
works, e.g. 123 [m ei [22i si ni na eusi- 

Let Gl be a compact set in R 2 and <p a window function in L 2 (R), with ||9?|| 2 = 1- The 
time-frequency localization operator H is defined by 

( 5 ) Hf = JJ^V ip f(z)ir(z)pdz = V*xnV v f- 

Note that while we denote a time-frequency localization only by H, we emphasize that 
it is dependent on the window ip and the region f2. 

The above integral can be interpreted as the portion of the function / that is essen¬ 
tially contained in Q. Moreover, the following inner product involving H measures the 
function’s energy inside 17: 

(Hf,f)= [f V v f(z){n(z)<p,f)dz= [[ \V v f(z)\ 2 dz. 

We will say that a function / € L 2 (R) is (e,p)-concentrated inside fl if (Hf,f) > 
(1 — e )||/||I or equivalently ((I — H)f, f) < e||/111, where I is the identity operator. 

The time-frequency localization operator H is a compact and self-adjoint operator so 
we can consider the spectral decomposition 

OO 

( 6 ) Hf = ^2a k (f,4’ k )if k , 

k =1 

where {ak}kLi are the positive eigenvalues arranged in a non-increasing order and {4’k}’ k Li 
are the corresponding eigenfunctions. By the min-max theorem for compact, self-adjoint 
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operators, the first eigenfunction, has optimal time-frequency concentration inside hi in 
the sense of ©, i.e. 



\V v il>i(z)\ 2 dz 


max 
11/112 = 1 



2 dz. 


In general, the hrst N eigenfunctions ipi, ip 2 , ■ ■ ■, "0 n form an orthonormal set in L 2 (M) 
having optimal cumulative time-frequency concentration inside 17: 


ff I V v ip k (z)\ 2 dz 

k=i JJn 


max 

{<pk } fcL 1 orthonormal 



\V<p<!>k{z)\ 2 dz. 


If we let Vn be the span of the first N eigenfunctions and if / € V/v so / = X/DLi (/> V’/OV’fc) 
then 

N N 

(7) (HfJ) =^2a k \(f,ipk) I 2 > aw5^K/,^fc)| 2 = ajv||/|||- 

/c=l /c=l 


This implies that a function / in V/v is at least (1 — ajv, ^-concent:rat'ed on 17, and 
any other orthonormal, IV-dimensional subspace cannot be better concentrated than 
(1 — o/v, ^-concentrated on fl. 

By contrast, functions which are (1 — ajv , ^-concentrated on 17 need not lie in V/v. 
The following proposition characterizes a function that is (e, ^-concentrated on 17. 


Proposition 3.1. Let <p, 17 and e be given and let Nq be the integer such that ct/v 0 > 1 — e 
and ct/v 0 +i < 1 — e. Furthermore, let f ker denote the orthogonal projection of f onto the 
kernel kev(H) of H. A function f in L 2 (R) is concentrated on 17 if and only if 

No 00 

J2(a k + £- l)|(/,0c)| 2 > ( 1 -£-«fe)K/>V’fe)| 2 + ( 1 -£)||/feer|||- 

k= 1 k=No~\~l 

Proof: The eigenfunctions {if k } k form an orthonormal subset in L 2 ( R), possibly incom¬ 
plete if ker(ii’) / {0}; hence, we can write / = + fker and, as in l]T|), 

(Hf, f) = Yffk= 1 a k\{fi V’fe) | 2 - So the function / is (e, ^-concentrated on 17 if and only if 

OO / OO 

X^fcK/’V’fc)! 2 > (1 -e) ( ^\{f^k)\ 2 + WfkerWl 

k= 1 \fc=l 

and the conclusion follows. ■ 



Remark 3.2. A function / in L 2 (M 2 ) is (1 — a/v, (^-concentrated on 17 if and only if 

N —1 00 

x (a k ~ a N )\(f,fJk )\ 2 > X (&N ~ u k )\{f,if k )\ 2 + a N \\f ker \\l. 

k =1 

In [5j Theorem 3.1], Daubechies bounded the error of a function’s local approximation 
using a finite number of Gabor atoms by means of an estimate based on the function’s 
and its Fourier transform’s projection onto bounded intervals. In order to achieve a 
similar bound, but for more general regions, in Proposition 14.41 in the next section, we 
consider the projection of a function / onto the best-concentrated eigenfunctions of a 
localization operator and derive the following estimate. We note that approximations 
of bandlimited functions via projections onto eigenspaces of approximately time- and 
bandlimited functions were presented in mm- 


SAMP. TF-LOC. FUNCTIONS AND CONST. LOC. TF FRAMES 


5 


Proposition 3.3. Let f be concentrated on fl C M 2 . For fixed c> 1, let fik-, k = 

1,..., N, be all eigenfunctions of H corresponding to eigenvalues ak > ■ Then 


N 

f ~^2(f, i>k)^k 


k =1 


< cs\\f\\l 


2 


Proof : Without loss of generality, we assume that \\fW 2 = 1- We have, by assumption: 


(HfJ) = J2a k \(f,^ k ) | s 


k =1 


I V<pf(z)\ 2 dz > (1 - e 


We argue by contradiction; to this end, assume that Ylk=i Kfii’k)] 2 = K < 1 — ce. 
Furthermore 

OO 

II/II2 = 1 = ^ fc )| 2 + ll/fcer||! > 

fe=l 

hence 

OO 

£ l(/,^)| 2 = l-^-||/ fcer || 2 . 

fc=Af+l 

We then have 

00 1 

X] a fcK/>V’fc)| 2 < -(1 --S'- WfkerWl) 

k=N+1 C 

such that 

OO 1 

V a*| (/, ifk) I 2 < K + — • (1 - K - II her III) 

k =1 C 

c-l + lF C — 1 ^ ||2 

WJker 2 

C C 

1 , 1 - ce - 1 c - 1 2 

< 1 H-/ter 2 < 1 — £, 

C C 

which is a contradiction. Hence, ^2k=i K/> V’fc)! 2 must be greater than or equal to 1 — ce. 


We note that while Hf is interpreted as the part of / in fl, the uncertainty principle 
prohibits its STFT to have nonzero values only in fl, cf. [28], and there will always be 
points z € M 2 \ fl at which \V ip Hf(z)\ 0. It can be shown, however, that \V ip Hf(z)\ 
decays fast with respect to the distance of 2 from fl. Daubechies proved this result in [4] 
for the case where the window function is the Gaussian <po(t) = e~ nt , showing that the 
pointwise magnitude of the STFT decays exponentially. 

Lemma 3.4 (Daubechies, [4]). Let H be a time-frequency localization operator over the 
region fl with the Gaussian as its window function, i.e. p = po- For any 5 between 0 and 
l, and f £ T 2 (M) , one has 

\(Hf,TT(z)p 0 )\ < -^<T 2 ||/|| 2 exp[-§(1 - 5)dist(z,D) 2 ]. 

A similar result involving windows with milder decay conditions is the following. 
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Lemma 3.5. Let cp, g G L 2 (M) such that ||+||2 = 1 and, \V^g{z)\ < C{ 1 + \z\ 2s ) 1 , /or 
some C > 0 and s > 1, for all z € M 2 . For any 5 between 0 and 1, one has 

KHf(z)\ = \(Hf, Tr(z)g)\ < C S 8~T S ||/|| 2 (1 + (1 - d)dist(z, H)T\ 

where C s = /Y** . 

a/ s sin(7r/s) 

Remark 3.6. An example of the inequality < C( 1 + |z| 2s ) _1 being satisfied for 

all z € R 2 is when ip and g are in the Schwartz space <S(M). Moreover, in that case, for 
every s > 0, there is a C for which the inequality is satisfied. 

Proof: If z, z' € M 2 , then |(7r (z')p, n(z)g)\ = | (<p, 7r(z — z')g)\ < C' s ( 1 + \z — z' l 25 )^ 1 . 

For 0 < 6 < 1, 


\(Hf,ir(z)g)\< II \(f,n(z')p)\\(iT(z')ip,iT(z)g)\dz' 

1 


n 


<C |(/,7r(2'V)l 


< c \(f-,K{z')p)\ 


1 + 1 z — z'\ 2s 

1 


dz' 


< CV 2 


1 + (1 — (5) inf \z — z'\ 
z'en 


\f\ + 5\z — z'\ 2s y 7 ! + (1 — d)\z — z'\ 2s 


dz' 


l + 5\z — z 


1 1 2s 


\(f,n(z')ip)\ 2 dz‘ 


CV2 7I- . 2 s(! + (!. — 6) inf \z — z\ s ) 1 1 |+|| 2 ||/|| 2 , 

yssmyK/s) z 


and the conclusion follows. 


4. Local Gabor approximation and new TF dictionaries 

We shall make use of the results concerning time-frequency localization to obtain an 
approximation of a function using a finite Gabor expansion. We expect that if the 
function is well localized on a region fI in the time-frequency plane, then / can be 
approximated with good accuracy using only the Gabor coefficients on a larger region 
covering Ll. From the local Gabor systems, we will obtain frames for the eigenspace, the 
collection of which forms a frame for L 2 (R). 

4.1. Time-frequency localization and local Gabor approximation. In this sec¬ 
tion, we consider a given region fl in R 2 and let Vn be the A-diiriensional subspace 
spanned by the first N eigenfunctions of the corresponding localization operator H. 
Here, the eigenvalues are assumed to be arranged in descending order. Furthermore, we 
let g be a window function in L 2 (M) such that ||<7|| 2 = 1 and \V ip g{z)\ < (7(1 + |z| 2s ) -1 for 
some C > 0 and s > 1. We then consider the Gabor system Q(g, A), assume that it forms 
a frame with lower and upper frame bounds A and B, respectively, and let {g\ : A £ A} 
be its dual frame. 

We first have the following approximation of a function in Vn local Gabor atoms. 
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Proposition 4.1. For any e > 0, there exists an 12* D 12 such that 


( 8 ) 


/- XI (f’9x)g\ 

AeAnfi* 


< e||/||2, /or all f £ Pat. 


Proof: Let e > 0 and / £ Vn- We first observe that for any IP D 11, 


AeAnn* 


< 


TV , 

X</. 

X ^k-,g\)g~\) 

k= 1 v A^Ann* 7 

AT 

(XK/> V’fc)! 

' k=l 

X ^k,g\)g\ 

A^Anfi* 


TV 


TV 


<XK/^>I 2 X X (^k,9x)gx 

k =i fc=i A^Ann* 


AT 


< 


-1 


X X K^fc, 5 A)| 2 - 

fc=lA^AnQ* 

We consider K^AuSa)! and note that |(V ; fc, 5 A)| = ^r|(-£L0fc, g \)|. Since 5 satisfies |V ¥ ,^(^)| < 
(7(1 + |z| 2s ) _1 , it follows from Lemma 13.51 that \{f>k,g\)\ < ^-(7 S 22^ (1 + 5 dist(A, H) s ) _1 , 
where 6 is taken to be which gives us 

2 / N \ 

f- X (f’ 9 \)g~\ < A^WfWlc 2 ^ ( X-2 ) X (! + 2 dist(A ,ny 


\s \-2 


AeAno* 2 v fc=1 ' K/ A^AnQ* 

The right-hand side of the above inequality approaches 0 as 11* gets larger. In particular, 
given e > 0, one can choose IP so that the sum 

TV 


X (1 + 5 dist(A, H) s ) 2 <e 2 /(a 1 (7 2 2« X 

A^Anfi* ' 

which gives the conclusion of the proposition. 


1 


k =1 


We show an example for the case where the window function is the Gaussian cpo and the 
region H is the disk B(0, R) with center at the origin O and with radius R. We will make 
use of the decay of the STFT of H in Lemma l3. ll First, we prove the following lemma that 
gives an estimate on the decay of the tail of the sum of samples of the two-dimensional 
Gaussian outside the disk B(0,R*). Let Q(j) = [j\ — \,j 1 + - 7 ) x [72 — \ , .72 + ^), j = 
(j' 1 ,/ 2 ) e z 2 . 

Lemma 4.2. Let A be a relatively separated set of points in M 2 with sup z eR 2 G 

Q(z)) =: N\ < 00 . Fix R > 0. If R* > R, then 

(9) X exp(-f (|A| - R) 2 ) < C\ exp ( - f - R 2 )), 

AeA, |A| >R* 

where C\ = 8exp(^)N\. 

Proof: Let R* > R and define the sets 

Jr* = {j € Z 2 : Q(j) n (M 2 \ B(0, R*)) J 0} and 
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A R*J = {A e A : |A| > R*, A G Q(j)}. 

We are then able to rewrite the left-hand side of ([9]) as 

(10) 53 ex P(-?(l A l - ^) 2 ) = 53 53 e xp(—f (|A| - R) 2 ). 

AgA, |A|>i?* 

If A, z € Q(j), then |A| > \z\ — \/2. And since — (|z| — R — \/2) 2 < — ( ^ Y -2), 

have 

e -f (IAI-R) 2 < e -^\z\-R-V2? < e - exp ( _ |(| Z | _ R fy 

Using the inequalities — (\z\ — R ) 2 < — —f- R 2 and —(R* — V2) 2 < A 2, we 

estimate Co]) as follows: 


we 


53 53 ex p(-f(iAi -r) 2 ) < Y 53 

3&Jr* \£A r *j J&Jr* AeA fl » 


Q CO 


ex P ( “ f (M - R ) 2 ) dz 


< N a e' 


// 

J Jm 


R 2 \B(0,R*-V2) 


ex p (- \ (M - R ) 2 ) dz 


^ 7rifr* 

< N\ e e~ 


IL 


exp ( — ^-) dz 


l\z\>R*-V2 
= 8N A e n e^r exp ( - < R *~^ 1)2 ) 

< 8N A e^ exp ( - ~ r2 ))- 

57T 

By taking C A = 8N A e~* , we get the conclusion of the lemma. ■ 

Example 4.3. Suppose that the Gabor system {<^o,A := 7r(A)(/?o : A € A} forms a 
frame having upper and lower frame bounds A and B, respectively, and let the system 
{^x ■ A £ A} be its dual frame. Then, for any e between 0 and 1, there exists R e > 0 
such that if 12 is a disk centered at the origin with radius R, the following inequality 
holds for all / £ V/v: 


( 11 ) 


/- 53 (/’¥> o,a)^o,a 

|A|<i?+i? e 


< e 


Here, we can take R s > —R + ./4 R 2 — ^ ln(e 2 /A 1 C A Ylk =l A)j w h ere C A = 8N A e 


57T 
4 . 


Proof: Following the proof of Proposition 14. 11 we have for 11* D 11, 


/- 53 (f'V o.a)^o,a 

AeAnn* 


N 


<A 1 ||/||153 53 iK- ff n.W)V’fc>¥’o ) a)| 


fc=l A^AnD* 

We can take H* to be a disk centered at the origin with radius R* := R + R e > R. We 
use Lemma 13.41 (with 4=1) and Lemma 14.21 to estimate the double sum on the right 
side as follows: 

N N 

53 53 o,a)i 2 <53 53 ^exp(-§dist(A,i2)^ iL/ - 112 


k= 1A^AnQ* 


k= iA^Ann* 
N 


53 53 ^2 exp(-f (|A| - l?) 5 


fc=l |A|>R* 
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N 


k =1 




Now, exp (— f - 4? 2 )) — £2 /A 1 C y a “r whenever i?* is greater than or equal 

to ^ IAR 2 — ^ In (e 2 /A~ l C\ Ylk=i > and the conclusion follows. ■ 

The following proposition gives a localization result by means of a given Gabor frame 
whose atoms are known to have sufficient TF-localization, provided by the condition 
\V v g{z)\<C{l + \z\ 2s )-k 

Proposition 4.4. For all N >0 and all e > 0, there exists a set f!* D O ml 2 , such that 
for all f € L 2 (M) with corresponding orthogonal projection /at onto the TF-localization 
subspace Vn, the following estimate holds: 


( 12 ) 

Proof: Since 


f~ y ( f,9\)9\ 

AeAnn* 


< (i + v'1?)ll/-A* + £ ll/ll 2 - 


/ 


(/, g\)g~\ 

AeAn n* 


< 11/ - /at|| 2 + 


In 


2 


( fN,g\)gx 

AeAnn* 2 


+ 


y, {fN - f,g\)g\ 

AeAnfi* 


2 


the result follows from Proposition 14.11 and the boundedness of the associated analysis 
and synthesis operators. ■ 


As a corollary, we obtain the following result for local approximation of functions with 
known time-frequency concentration in a given set 14 by Gabor frame elements. 


Corollary 4.5. For fixed c > l, let tpk, k = 1,..., N, be the eigenfunctions of H cor¬ 
responding to eigenvalues ak > For N and e > 0, choose a set 14* D 14 as in 

Proposition Then the following approximation holds for all functions f which are 
(e ,<£>)-concentrated on 14: 


(13) 


/ 


y (/, g\)g~\ 

AeAnn* 



(Vce + e)||/||2- 


Proof: The result follows immediately from Proposition 13.31 and Proposition 14.41 . ■ 


4.2. Local and global frames with TF-localization. The next results deal with the 
construction of frames for the subspace Vn of eigenfunctions of H, and the whole of 
L 2 (M), respectively. Denote by Vn the orthogonal projection operator onto the subspace 
V N . 

Proposition 4.6. If e < 1 and inequality ((HJ) is satisfied, then for all f € Vn, 

(14) A(l-e) 2 \\f\\ 2 2 < y \(f,g x )\ 2 <B\\f\\l 

AeAnQ* 
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where A and B are lower and upper frame bounds, respectively, for Q(g, A). This im¬ 
plies that the system {Vn9x} x^Ann* forms a frame for Vn- More generally, the sys¬ 
tem {7r(i')'PAr7r(A)g}A£Anf2* > where v € M 2 , forms a frame for the subspace tt(u)Vn '■= 

M*')/ : / € V N \- 

Proof: From Proposition 14.11 we get 


Y (f, 9x)g~x 
AeAnfi* 


< 


And we obtain 


(1 -e) 2 ||/||| < 


/- Y ( f’9\)g~x 

AeAnfi* 


Y gx ^ gx 

AeAnD* 


< e 


< 4 Y k /’^ a ) i 5 


AeAnfi* 


A 
B 

< ~^\\J 112- 

For the subspace v t{v)Vn, we first note that 

II/II 2 = IKH/II 2 and (f,V N g\) = (n(v)f,Tr(v)V N g\). 
The inequality in (|14l) can then be reformulated as 


A(1 -e) 2 ||vr(^)/||l < Y K^W/^W^a^a)! 2 < B\\-K(v)f\\l, 

AeAnn* 

for all / € Vn, or 7 r(v)f € it(v)Vn■ ■ 

It follows from Proposition 14.61 that any function / € Vn can be completely recon¬ 
structed from the samples {{f,gx)}x&Ann*- In [IS Theorem 3.6.16], a reconstruction pro¬ 
cedure was presented where a function on a closed subspace can be reconstructed from re¬ 
stricted Gabor coefficients. Following its approach, we apply the following iterative recon¬ 
struction for functions in Vn from the local STFT samples, where U\ oc f = {(/, 5A)}AeAnQ* 
and K c c = EagAhQ* c xdXi c = {c A } AeA nn* : let /o = 0 and define recursively 

(15) fn = fn—l + V N Uf oc ((f, gx) - C/loc/n-l). 

We implement the above reconstruction procedure in Section[5] observing the dependence 
of the performance of the algorithm on the choice of fP. 


Remark 4.7. 

(a) Since {Vn9x : A E A n IP} is a frame for Vn, in the language of [2], the system 
{gx '■ A € A n fP} is also called an outer frame for Vat. Related terminologies, 
e.g. atomic system, resp. pseudoframe for the subspace Vn, appear in mm - in 
particular, by Proposition 14.61 and [20 ; Theorems 2 and 3], the sequence {gxy^}, 
where g^ N = Vn{UV n )^gx is called a dual pseudoframe sequence for Vn with 
respect to {g A }. This sequence coincides with a dual frame to the frame {Vn9x} 
for Vn- 
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(b) It may sometimes be more natural to use, instead of the projection Vn , the 
approximate projection operator Hn defined as: Hjyf := Zfc=i a fc(/> Ob¬ 

viously, since we use a finite sequence of positive weights y/aik, we obtain an 
equivalent frame for the subspace Vn, if Vn is replaced by Hn in Proposition ^. 61 

We now consider a family of time-frequency localization operators H^, p, E A over the 
region with a common window function tp. In [9j Theorem 5.10], Dorfler and Romero 
showed that under certain conditions on H^, one can choose such that 

_ ^ 

(16) ll/ll!*EEK«>l 2 > 

A k=\ 

where the functions {ifZ} are eigenfunctions of PPL We use this result to obtain a frame 
for L 2 (M) consisting of local frame elements on the time-frequency localized subspaces. 

Theorem 4.8. Let be a family of compact regions in M 2 such that 

2 < inf^ltynl < sup e ^|n M | < oo and Z^eA Xn „ ~ 1, and let p E 5 0 (M) such that 

ll* = l- 

Corresponding to each /i E A, choose lattices and windows g^ E L 2 (R) with ||g M ||2 = 
1, \V:~g II '(z)\ < C m (1 + |z| 2s ' 1 ) -1 for some C^> 0 and > 1 such that for all p the system 
Q(g fl ,A fi ) is a frame for L 2 (M) with frame bounds A p and B^. 

Denote by Vn,, i/ie span of the first Nf eigenfunctions of corresponding 

to the Np largest eigenvalues, where each N^ is chosen so that (USD holds. 

If 0 < < 1 such that 0 < inf ^^(1 — e M ) 2 < sup^ tg ^ B^ < oo, then there exist 

Al* D such that the global system U^eA^A^M^jAeA^nfi* a frame for L 2 (M). 

Proof: Let / E L 2 (M) and p E A. We first note that the conditions on the regions Q /t 
and ensure that (USD holds, cf. [9]. Since (/, TV M 7r(A)s^) = (V N J,ir(\)g^), it follows 
from Proposition 14.61 that for every E (0,1), there exists Al* D such that 

iV M AL 

A M (1-6 M ) 2 ^|(/,^)| 2 < E l(/,^vr(A)^)| 2 <^El^^)| 2 - 

fc=i AeA^no* fe=l 

By the assumption that 0 < A := inf^ g ^ A^(l — e^) 2 < B := sup^ g ^ Bp < 00 an( l the 
equivalence in (USD, we get 

1V m 

^EEk/.«i 2 sE E K/.^^OMtsBEEK/.Oit 

/xEA 1 /xEA /iEA & = 1 

and finally Z Z l(/:^iV M 7r(A)5 M )| 2 x ||/|| 2 . ■ 

M eA AeA^nn* 


Remark 4.9. 

(a) For the special case where each is just the translated region fi + Ll, if {ipk}k£N 
is an orthonormal system of eigenfunctions of H, then one can choose N E N 
and LI* D A! such that UAeAnn* G{Vn9\, A) is a frame, or a multi-window Gabor 
frame, for L 2 (M). 
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This global system forming a frame obtained from local systems is comparable 
to quilted Gabor frames introduced by Dorfler in [7], the difference being the the 
projection of the time-frequency dictionary elements onto the time-frequency lo¬ 
calized subspaces. In [2T], Romero proved results concerning frames for general 
spline-type spaces from portions of given frames which provide existence condi¬ 
tions for quilted Gabor frames. 

If = 1, each is a separable lattice, i.e. = a^Z x Z, > 0, 

and the samples {(/, 7r(A)(7 M )}AeA^nn* are given, then / can be recovered com¬ 
pletely from the samples if the set of sampling functions n 

form a quilted Gabor frame. In m, the authors presented an approximate re¬ 
construction of / from the given samples using approximate projection in 
Remark 14.7( b). In particular, the following error 

fi£A AeA M nf2j 2 

was estimated, and numerical experiments were performed in comparison with 
the method presented in [21] that used truncated Gabor expansions with weighted 
coefficients. Through the numerical experiments, it was illustrated how (1171) can 
be decreased by having a larger region fl* or a larger number A r fl of eigenfunctions. 

5. Numerical Examples 

In this section, we consider examples in the finite discrete case ( C L , L = 480) that 

illustrate the results in the previous sections. The experiments were done in MATLAB 

using the NuHAG Matlab toolbox available in the following website: 

http://www.univie.ac.at/nuhag-php/mmodule/. 

Each point set A that we will use for a Gabor frame is a separable lattice aZ^ x 6Z^, 

where a and b are divisors of L and also called lattice parameters of A. The redundancy 

of A is given by —. For more details on Gabor analysis in the finite discrete setting, the 
ab 

reader is referred to the [25]. 

5.1. Experiment 1. We first examine the approximation of time-frequency localized 
signals by a local Gabor system, in particular, functions lying in the Wdimensional 
subspace V/v of eigenfunctions of H, as shown in Proposition 14.11 In this example, we 
take fl to be a disk centered at the origin with radius 80 and ip to be a normalized 
Gaussian. 

Figure [T| shows the STFT of a signal in Vjv and the sample points taken over circular 
regions with varying radii, each containing fi. In each case, the sampling points are 
obtained by restricting a lattice with parameters a = b = 20 (redundancy 1.2) over 
the circular region. The error of the approximation \[Pn — 5' loc T , Ar||op ) where 5 loc is a 
truncated tight frame operator, is shown in Table [T] below. 

We saw in Proposition 14.61 that if e < 1, corresponding to the operator norm \\Pn — 
5 loc RAr|| Op being less than 1, then the local Gabor system projected into Vn forms a 
frame for Vjy so perfect reconstruction is possible by the reconstruction algorithm (fl5l) . 
The performance of the reconstruction algorithm is shown in Figure [2] As expected, the 
larger the covering region, the faster the convergence. 


(b) 


(c) 


(17) 
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Cover radius 80 


200 


100 


0 

Kir* 


-100 


-200 


- 

200 0 200 


Cover radius 120 

200 


100 


0 

!j?i5i;; 

-100 

-200 



-200 o 200 



Cover radius 100 

200 


100 


o 

IRiSili 



-100 


-200 


- 

200 0 200 


Cover radius 140 

200 


100 


0 




-100 


-200 


- 

200 0 200 


Figure 1. Sampling points over various enlargements of the covering region. 


Cover radius 

No. of samp. pts. 

Op. norm error 

80 

45 

0.9650 

100 

77 

0.1105 

120 

109 

0.0194 

140 

145 

0.0031 


Table 1 . Error \\Vm — S ,loc 'Pjv||op over varying radii for the disk 



Figure 2. Convergence of the reconstruction algorithm from the local 
samples with the same lattice parameters but with varying radii of the 
covering regions. 
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5.2. Experiment 2. In this next experiment, we look at an example of how the collection 
of local Gabor systems can form a frame given that the sum of the characteristic functions 
over the regions is bounded above and below by a positive number. Figure [3] shows ten 
regions in the TF-plane and Figure 0] shows its sum. 


Region 1 Region 2 Region 3 Region 4 Region 5 



-200 0 200 -200 0 200 -200 0 200 -200 0 200 -200 0 200 


Region 6 Region 7 Region 8 Region 9 Region 10 



-200 0 200 -200 0 200 -200 0 200 -200 0 200 -200 0 200 


Figure 3. 


Ten regions that partition the time-frequency plane. 


Sum of the characteristic functions 



Figure 4. Sum of the characteristic functions over the ten regions. 

Sample points are then taken over sets that contain each region, where different lattices 
are used for each set. The lattice parameters assigned to each set are summarized in Table 
[21 and the sample points are depicted in Figure [5l The left image shows sample points 
obtained by restricting each lattice over the regions themselves, while the samples in the 
right image are obtained from the restriction over larger sets containing each region, thus 
producing more overlap. Tight windows are used corresponding to each set of restricted 
lattice points. 

We form a quilted Gabor frame from the collection of local Gabor systems. And 
by projecting each local Gabor system onto the local subspace corresponding to each 
region, we likewise obtain a global frame as in Theorem 14.81 The average of the relative 

error IIJ , 112 when the frame operators Si and S 2 , corresponding to the quilted Gabor 

II/II 2 

frame (i.e. without projection) and the global frame (i.e. with projection), respectively, 
are applied to a random signal / are shown in Table [3j 
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Region 

(a, 6) 

Region 

( a,b ) 

1 

(20,20) 

6 

(15,15) 

2 

(16, 20) 

7 

(12,15) 

3 

(20,16) 

8 

(12,12) 

4 

(16,16) 

9 

(10,12) 

5 

(15,16) 

10 

(10,10) 


Table 2. Lattice parameters over the different regions. 


Sampling points, less overlap Sampling points, more overlap 




Figure 5. Sampling points on the different local patches. 



without projection 

with projection 

Less overlap 
More overlap 

0.2610 

0.5840 

0.1687 

0.1709 


Table 3 . Average of the error in applying the frame operator to a random 
signal (average of 1000 attempts). 


In both cases of less and more overlap, projecting onto the TF-localized subspaces 
decreases the relative error between the signal and the approximation by the frame oper¬ 
ator. Note that in both quilted Gabor frame and the global frame with projection, having 
more overlap increases the relative error since we are just comparing / with Sif. Since 
we are dealing with frames, perfect reconstruction (up to numerical error) is possible via 
the frame algorithm cf. m Algorithm 5.1.1]. 

We first compare the respective condition numbers of the frame operators for the 
cases of less and more overlap. The values are shown in Table 01 Once again, in both 
quilted Gabor frame and the global frame with projection, having more overlap improves 
the condition number. Note that the large condition number for the frame operator 
corresponding to the global frame with less overlap can be attributed to the lower frame 
bound in Theorem Id.81 which is related to the set Q* that covers the region 12^ - a smaller 
region 17* implies a smaller lower frame bound. 

Figure [6] compares the convergence of the frame algorithm for the four cases considered. 
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without projection 

with projection 

Less overlap 
More overlap 

5.1429 

3.5472 

16.0406 

1.9845 


Table 4. Condition numbers of the resulting frame operators. 



Figure 6. Convergence of the frame algorithm. 


5.3. Experiment 3. In this final experiment, we illustrate the approximate reconstruc¬ 
tion of a signal from analysis coefficients obtained from a union of tight Gabor systems, 
each restricted on an enlarged region covering a given region of interest, forming a quilted 
Gabor frame (see Remark 14.91 c)). 

Similar to the experiment in |lflj we consider four rectangular regions and associate 
tight Gabor frames to each one: 

1. f/(gi,20,8) on the region corresponding to lower frequency and time t < L/ 2; 

2. G(g 2 i 24,10) on the region corresponding to lower frequency and time t > L/2\ 

3. G(gs, 12, 24) on the region corresponding to higher frequency and time t < L/ 2; 

4. G(g 4 ,15, 20) on the region corresponding to higher frequency and time t > L/2. 

The sample points on the four regions are depicted in Figure [71 

We apply an approximate projection onto the subspaces of eigenfunctions of the time- 
frequency localization operators on the regions and compute the relative error from the 
approximate reconstruction. We compare the relative errors over varying overlap b (the 
amount of increase in the length of a side of the rectangular region) in Figure [8] for three 
different eigenspace dimensions (nEV). We also include the relative error obtained from 
re-synthesizing with the same quilted Gabor frame elements. 

For the case of quilted Gabor frames, an overlap would initially decrease the relative 
error in the approximate reconstruction but since we are just essentially getting the 
error from applying the frame operator on the signal, more overlap in the regions would 
eventually lead to an increase in the relative error. For the cases with approximate 
projection, we see the decrease in the relative error as the overlap amount increases. 
Moreover, the relative error improves as the eigenspace dimension is increased. 
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Sampling points 



50 100 150 200 250 300 350 400 450 


Figure 7. Sampling points over the four regions. 



Figure 8. Approximation error vs. amount of overlap. 


6. Conclusions and Perspectives 

In this paper we investigated the representation of time-frequency localized functions 
by means of sampling in the time-frequency domain. Motivated by the problem of pro¬ 
viding dictionaries with good concentration within prescribed regions in time-frequency, 
we constructed frames of localized time-frequency atoms. The improved localization is 
obtained by means of projections onto eigenspaces corresponding to time-frequency lo¬ 
calization operators. Numerical experiments illustrated the promising potential of the 
proposed method: providing good reconstruction/approximation quality while preserving 
the good localization property. However, for applications to real signals, the proposed 
method would entail having to compute for eigenvalues and eigenfunctions of large ma¬ 
trices, which may be numerically cumbersome. The study of efficient numerical methods 
for the evaluation/approximation of eigenvalues and eigenfunctions of time-frequency 
localization operators would be a topic of future work. 
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